A Formal Proof of the Expressiveness of Deep Learning
نویسندگان
چکیده
Deep learning has had a profound impact on computer science in recent years, with applications to image recognition, language processing, bioinformatics, and more. Recently, Cohen et al. provided theoretical evidence for the superiority of deep learning over shallow learning. We formalized their mathematical proof using Isabelle/HOL. The Isabelle development simplifies and generalizes the original proof, while working around the limitations of the HOL type system. To support the formalization, we developed reusable libraries of formalized mathematics, including results about the matrix rank, the Borel measure, and multivariate polynomials as well as a library for tensor analysis.
منابع مشابه
Expressiveness of Deep Learning
Deep learning has had a profound impact on computer science in recent years, with applications to search engines, image recognition and language processing, bioinformatics, and more. Recently, Cohen et al. [2] provided theoretical evidence for the superiority of deep learning over shallow learning. For my master’s thesis [1], I formalized their mathematical proof using Isabelle/HOL. This formal...
متن کاملPrediction of Iranian EFL Learners’ Learning Approaches Through Their Teachers’ Narrative Intelligence and Teaching Styles: A Structural Equation Modelling Analysis
It goes without saying that there are many influential factors affecting the success of any learning experience, and teachers are definitely among the significant factors influencing the process of teaching and learning. In this respect, the present study sought to investigate the prediction of Iranian English as a Foreign Language (EFL) learners' learning approaches through their teachers’ nar...
متن کاملAn Isabelle Formalization of the Expressiveness of Deep Learning
Deep learning has had a profound impact on computer science in recent years, with applications to search engines, image recognition and language processing, bioinformatics, and more. Recently, Cohen et al. provided theoretical evidence for the superiority of deep learning over shallow learning. I formalized their mathematical proof using the proof assistant Isabelle/HOL. This formalization simp...
متن کاملSimilarity measurement for describe user images in social media
Online social networks like Instagram are places for communication. Also, these media produce rich metadata which are useful for further analysis in many fields including health and cognitive science. Many researchers are using these metadata like hashtags, images, etc. to detect patterns of user activities. However, there are several serious ambiguities like how much reliable are these informa...
متن کاملA formal approach to the analysis of clinical workflow languages
Objective: To develop proof strategies to formally study the expressiveness of workflow-based languages, and to investigate their applicability to clinical workflow languages. Method: We propose two strategies for studying the expressiveness of workflow-based languages based on a standard set of workflow patterns expressed as Petri Nets and notions of congruence and bisimilarity from process ca...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017